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(54) Digital data encode system 

(57) A digital data encode system tor inserting water 
mark data into digital data signals having a series of 
field data by use of a water mark data inserting device 
(140), said digital data encode system comprising a 
field judging unit (120) dividing the digital data signals 
by a predetermined reference, a water mark data selec- 
tion output unit (130) for selecting proper one of a plural- 

fig. 



ity of different water mark data prepared correspon- 
dingly to the division according to the judgement result 
of the field judging unit (120), and a water mark data 
inserting device (140) for inserting the water mark data 
supplied from the water mark data selection output unit 
(130) into the digital data signals. 
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Description 

BACKGROUND OF THE INVENTION 

F1ELP OF THE INVENTION 5 

The present invention relates to a digital data 
encode system and a water mark data inserting method 
for inserting water mark data in the digital data signal 
having a series of field data. 10 

DESCRIPTION OF THE RELATED ART 

Recently, there has arisen the necessity of develop- 
ing means for preventing illegal copying of digital data, is 
especially digital image data, with the advance of an 
information processor and a communication network 
and the electron izati on of various media. 

Data encryption technique has been proposed as 
this kind of technique for preventing illegal copying. This so 
digital data encryption technique is, for example, to ena- 
ble it to reproduce the encrypted digital image data in 
only a reproducing system having a proper cryptoanaly- 
sis key when digital image data is encrypted. The con- 
ventional encryption technique, however, has ouch a zs 
defect that if the encryption code is once broken, it can- 
not protect against the illegally copying thereafter. 

Therefore, a technique by use of water mark data is 
proposed, as another technique for preventing illegal 
copying of digital data, free from such a defect as a dig- so 
ital encryption technique has. Water mark data (digital 
water mark) is the special information to be embedded 
in digital image data itself in order to prevent the illegal 
use and copying of the digital image data. It includes, for 
example, information for authenticating the copyright 3S 
ownership and judging the infringement of the copy- 
right, and the copy protected information for preventing 
illegal copying itself. 

Such water mark data to be inserted in the digital 
image data includes two kinds of visible water mark 40 
data and invisible water mark data. Visible water mark 
data means such a special character, symbol, or other 
data to be inserted in the image that a person who sees 
the image with the water mark data combined therewith 
may perceive the water mark visually. This kind of visi- *s 
ble water mark data would naturally cause the deterio- 
ration of the image quality. While, it is effective in 
visually appealing protection against illegal copy or ille- 
gal data fluid. 

A conventional visible water mark data embedding so 
technique is disclosed in, for example, Japanese Patent 
Publication Laid-Open (Kbkai) No. Heisei 8-241403, 
"Digital Watermarking Free from Image Color Change" 
(hereinafter, referred to as the conventional technique 
1). According to the wator mark data inserting method ss 
of the conventional technique 1 , when combining visible 
water mark data with the original image data, the water 
mark data is combined with the original image data in a 
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way of changing only the brightness of the pixel corre- 
sponding to the non-transparent part of the water mark 
data without changing the chromaticrties, of all pixels of 
the original date. At this time, the scaling value for 
changing the brightness component of a pixel is deter* 
mined by the value of, for example, chromatic compo- 
nent, random numbers, and pixels of water mark data. 

Another example of the conventional visible water 
mark data embedding technique is disclosed in. for 
example, Japanese Patent Publication Laid-Open 
(Kokai) No. Heisei 5-236424, "Information Embedding 
Method and Its Apparatus" (hereinafter, referred to as 
the conventional technique 2). The water mark data 
inserting method according to the conventional tech- 
nique 2 comprises detecting means for detecting a 
region meeting a predetermined condition from image 
data, thereby tp embed the water mark In wery image 
data at the position corresponding to the region meeting 
the condition. The position for embedding the water 
mark depends on the content of the image. Therefore, it 
is very difficult to remove the water mark without much 
deteriorating the image quality. 

On the other hand, invisible water mark data means 
such special data to be inserted in the image that a per- 
son who sees the image with the water mark data com- 
bined therewith cannot perceive the water mark visually. 
This kind of invisible water mark data is embedded in 
the original image data in consideration of causing no 
natural deterioration of the image quality. As is under- 
stood from this, invisible water mark data is preferable to 
visible water mark data under the condition that a water 
mark preferably exists outside of the image data to be 
protected. 

The water mark data inserting technique by use of 
an invisible water mark causes little image deterioration 
and when embedding special information enabling the 
identification of a writer as water mark data, it can spec- 
ify the writer by detecting the water mark data even after 
illegal copying is performed. By embedding the copy 
protected information for disapproving copying or the 
copy prohibited information for prohibiting copying, in 
the original image data, and providing a reproducing 
device for reproducing the image data with a special 
function corresponding to the information, for example, 
it is possible to notify a user of the reproducing device 
that the image data is the copy inhibited data and to 
operate the special function within the reproducing 
dewice (copy protection function or the like) so as to 
restrict copying into VTR (Video Tape Recorder) when 
the reproducing device detects the copy protected infor- 
mation or the like- 
As the technique of embedding the invisible water 
mark data in digital image, there is, for example, a tech- 
nique of embedding the special information as a water 
mark in the digital image at the least influenced portion 
to the image quality in the pixel data (for example, LSB 
(Least Significant Bit)). This kind of the conventional 
invisible water mark data embedding technique is dis- 
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closed in, for example. Japanese Patent Publication 
Laid-Open (Kokai) No. Heisei 6-339110. "Image Infor- 
mation Transfer Method, Image Information Recording 
Device and Image Information Reproducing Device" 
(hereinafter, referred to as the conventional technique s 
3). The water mark data inserting method according to 
the conventional technique 3 transmits the image signal 
together with the copyright information and the genera- 
tion information overlapping each other, to the space 
other than the valid image space displayed on a screen T o 
of the image signal, and performs the generation restric- 
tion of the copy according to the copyright information 
and the generation information included in The received 
image signal at a receiver side. 
* The invisible water mark data embedding tech- is 

nique, however, is detective in that only the water mark 
data is easily removed from the image data with water 
mark data embedded therein, without deteriorating die 
quality of the original image data. For example, the 
information corresponding to the LSB of the pixel data 20 
will be lost by use of a low pass filter. Generally, the 
image compression processing aims to reduce the data 
amount on the whole by diminishing the information 
amount with respect to the least influenced portion to 
the quality in the pixel data. Therefore, the water mark 2s 
data embedded in the least influenced portion to the 
quality in the pixel data will be lost in the image com- 
pression processing. As mentioned above, the invisible 
water mark embedding technique has such a defect that 
it may be difficult to re-detect the water mark data in so 
6ome cases. 

Therefore, a technique of embedding invisible 
water mark data in a digital image as well as diffusing 
the water mark data into the frequency spectrum after 
frequency conversion of the image data (hereinafter, 3$ 
referred 10 as the conventional technique 4) is pre- 
sented (refer to Nikkei Electronics p. 13 (no. 660) 
4.22.1996), Since water mark data is embedded in the 
frequency component of the image data to be proc- 
essed according to the conventional technique 4. the 40 
water mark data is robust against the image compres- 
sion processing and the image processing such as fil- 
tering, and the water mark data won't be lost. Further, 
random numbers according to the normal distribution 
are used as the water mark data, thereby preventing the as 
interference of the respective water mark data even in 
the case of embedding a plurality of water mark data. 
Therefore, according to the conventional technique 4, it 
is difficult to destroy only the water mark data without 
much influence to the whole image data. so 

The conventional technique 4 will be. hereinafter, 
described with reference to Fig. 12. The waier mark 
encode system according to the conventional technique 
4 comprises, for example, discrete cosine transform 
(DOT) means 1210, water mark data output means 55 
1230 storing the water mark data 1231. a water mark 
data inserting device 1240, and inverse discrete cosine 
transform (inverse DOT) means 1250. The DCT is 
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adopted here as only one example of spectrally resolv- 
ing means of original image data, and any other conver- 
sion means than the DCT will do. 

In thus-constituted conventional technique 4, origi- 
nal image data is converted into frequency components 
by DCT, and n piece of data indicating higher frequency 
value are selected, each defined as f(1). f(2), .... 
f(n). On the other hand, each water mark data w(1), 

w(2) w(n) are selected from the normal distribution 

having a mean value 0 and a variance 1, and 
F(i)=f(i) + a I f(i) | * w(i) is calculated with respect to 

each i (where i=1 , 2 n; hereinafter in the same way). 

Where, a is a scaling element At the end, the image 
data with the water mark data embedded therein can be 
obtained as the frequency components by the replace* 
ment of f(i) with F(i). 

The water mark data detection according to the 
conventional technique 4 is performed in the following 
method, by way of example. The original image data 
and the water mark data candidate w(i) must be known 
values in the detecting method of the conventional tech- 
nique 4. At first, the Image data with the water mark data 
embedded therein is converted into the frequency com- 
ponents by use of DCT or the like, the element values 
corresponding to f(1 ), f(2), .... f(n) having the water mark 
data embedded therein in the frequency band are 

defined as F(1), F(2) F(n). By the use of f(i) and F(i), 

the water mark data W(i) is extracted, calculated by 
W(i)=(F(i) - f(i))/f(i) . Next, the statistical similarity C of 
w(i) and W(i) is calculated by use of the inner product of 
vector by C = w * w / (WD * wD) . Where. W = (W(1), 
W{2), W(n)) ( and w - (w(1), w(2). .... w(nj), WD is the 
absolute value of the vector W, and wD is the absolute 
value of the vector w. As the result of the above calcula- 
tion, when the statistical similarity C is a particular con- 
stant value or the more, it can be judged that the above- 
mentioned water mark data candidate has been embed- 
ded in the image data. 

If creating the image data with the water mark 
embedded therein by embedding the water mark data in 
the original image data by use of the conventional tech- 
nique 4 as mentioned above, it is effective for a writer 
owing the original image data to judge the illegality of 
the digital image data which may be illegal copy. 

The conventional technique 4 requires original 
image data and water mark data candidate w(i) in order 
to detect the water mark data as mentioned above. 
Therefore, it is effective for a writer owing the original 
image to detect any illegally-copied image data, how- 
ever, a reproducing device of a terminal used by a gen- 
eral user, because of having no original image, cannot 
perform the detecting processing of the water mark 
data. Then, a further improved technique than the con- 
ventional technique 4 for terminal processing, espe- 
cially MPEG system (hereinafter, referred to as the 
conventional technique 5) is proposed. 

In the conventional technique 5, original image is 
divided into blocks of 8 pixels x 6 pixels and the water 
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mark data embedding and detection is performed by 
use of the block unit for processing. In the water mark 
data embedding processing, the data is defined as 
1(1). f(2). .... f(n) sequentially from the lowest frequency 
component of AC component in the frequency band s 
after discrete cosine transform in the MPEG encode 
processing, the water mark data w(1), w(2), w(n) 
are selected from the normal distribution having a 
mean value 0 and a variance 1 , and 
F(i)=f(i) + a * avg (f(i)) * w(i) is calculated with io 
respect to each i. Where, a is a scaling element and avg 
(f(i)) is a partial average obtained by averaging the 
absolute values of three points around f(i), for example, 
f(i-1), f(i), and f(i + 1). The processing later than the 
MPEG encode processing will be performed by replac- 1S 
ing f(i) with F(i). 

On the other hand, detection of the water mark data 
will be performed in the following method. This detecting 
method requires no original image data and that only 

the data candidate w(i) (where, i=1, 2 n) must be a 20 

known value. In the block frequency band of blocks after 
inverse quantization of the MPEG decoding processing, 
the data from the lowest frequency component is 
sequentially defined as F(1). F(2), F(n). The average 
of the absolute values of three points around F(i) is 2s 
defined as the partial average avg (F(i)). the water mark 
data W(i) is calculated by W(i)-F(i)/avg (F(i)) , and the 
total WF(i) of W(i) for one image is calculated for every 
i. By use of the inner product of vectors, the statistical 
similarity of w(i) and WF(i) is calculated by 30 
C-WF * w/(WFD x wD) . Where, W=(WF(1), WF(2), 
.... WF(n)) ( w-(w(1), w(2) w(n)), WFD is the abso- 
lute value of the vector WF, and wO is the absolute value 
of the vector w. When the statistical similarity C is a par- 
ticular constant value or the more, it can be judged that 35 
the water mark data has been embedded in the image 
data. 

Insertion of a plurality of water mark data into one 
original image data can be adopted in order to attach a 
plurality of information such as writer information and 40 
copy protected information, to one image data. The con- 
ventional techniques 4 and 5, however, is defective in 
making the circuit size larger because of inserting a plu- 
rality of water mark data in one original image data and 
increasing the processing procedure. Namely, the con- 45 
ventional techniques 4 and 5 disclose a technique of 
inserting one water mark data in one original image 
data, however, with no consideration taken to the case 
of inserting a plurality of water mark data (for example, 
two water mark data) in one original image data. There- so 
fore, when inserting, for example, two water mark data 



6 

Japanese Patent Publication Laid-Open (Kokai) No. 
Heisei 6-315131, "Information Embedding Device And 
Reproducing Device" (hereinafter, referred to as the 
conventional technique 6). The conventional technique 
6 detects an area having no deterioration of the image 
even if replacing the data at the peripheral area when 
reproducing the information, for example, an equal 
background portion, by use of the relationship between 
a series of frames, and converts the level of the area to 
be converted, so to embed particular information 
therein. When reproducing the information* the area 
with the identification data embedded therein is speci- 
fied by use of the signal lacked portion and the conver- 
sion information, and corrected so as to reconstruct the 
image. 

The conventional technique 6, however, cannot 
embed the water mark information in all the frames, so 
that the frame with no water mark embedded therein is 
unable to protect against illegal copying. Since this tech- 
nique is on the assumption that successive frames are 
of freeze-frame pictures and that there is no change on 
the successive frames, an area for embedding the water 
mark data cannot be specified in the moving images of 
violence action, thereby making it impossible to embed 
the water mark data therein. 

Further another example of the conventional tech- 
nique of embedding water mark in a digital image is dis- 
closed in, for example. Japanese Patent Publication 
Laid-Open (Kokai) No. Heisei 5-30466, "Image Signal 
Recording Device and Signal Recording Medium" 
(hereinafter, referred to as the conventional technique 
7). The conventional technique 7 converts Image sig- 
naJs by frequency and embeds the information having 
the frequency signal lower than the frequency band of 
the image signal after frequency conversion. By the use 
of a high pass filter, the original image is taken out and 
the identification data embedded therein is taken out by 
the use of a low pass fitter. 

However, since the conventional technique 7 
embeds the water mark data in the lower frequency por- 
tion in the frequency band after frequency conversion of 
the image data, the water mark data can be easily 
removed by use of a high pass filter. When embedding 
the water mark data in the intensive frequency portion 
after frequency conversion, a filter cannot remove the 
water mark, but when inserting a plurality of water mark 
data, it cannot help deteriorating the image quality. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
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inat image data in the circuit of the same size as that of 
the conventional digrtal data encode system. 

According to the first aspect of the invention, a dig- 
ital data encode system having a water mark data 
inserting device for inserting water mark data into digital 
data signals having a series of field data, comprising, 

a water mark data inserting control means tor con- 
trolling inserting of the water mark by the water 
mark data inserting device; 

wherein the water mark data inserting con- 
trol means divides the digital data signals by a pre- 
determined reference and inserts a plurality of 
different water mark data prepared correspondingly 
to the division into the respective digital data of the 
corresponding divisions by use of the water mark 
data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields and even fields of a series 
of image frames, and the water mark data inserting con- 
trol means inserts first and second water mark data dif- 
ferent from each other and prepared for every odd filed 
and every even field into the respective corresponding 
fields, by use of the water mark data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields and even fields in a series 
of image frames, and the water data inserting control 
means comprising a field judging means for judging 
whether the filed data under processing is of an odd 
field or an even field upon receipt of the digital data sig- 
nals, and a water mark data selection output means, 
storing first and second water mark data different from 
each other and prepared for every odd field and every 
even field, tor supplying the first water mark data to the 
water mark data inserting device when the judgement 
result designates the odd field, or supplying the second 
water mark data to the water mark data inserting device 
when the judgement result designates the even filed, 
depending on the judgement result by the field judging 
means. 

In the preferred construction, the water mark data 
inserting control means inserts a plurality of different 
water mark data prepared for every signal component of 
the digital data signals extracted by a predetermined 
reference into the re$pective digital data signals of the 
corresponding signal components, by use of the water 
mark data inserting device. 

(n the preferred construction, the water mark data 
inserting control means comprising a signal component 
judging means for, upon receipt of the digital data sig- 
nals, judging whether the signal component of the dig- 
ital data signal under processing is brightness 
component, first colors ifference component, or second 
color-difference component, and a water mark data 
selection output means, storing three kinds of different 



water mark data prepared for every signal component of 
the above three kinds, for supplying the water mark data 
prepared correspondingly to the brightness component 
to the water mark data inserting device when the judg- 

5 ing result designates the brightness component, sup- 
plying the water mark data prepared correspondingly to 
the first color-difference component to the water mark 
data inserting device when the judgement result desig- 
nates the first color-difference component, or supplying 

10 the water mark data prepared correspondingly to the 
second color-difference component to the water mark 
data inserting device when the judgement result desig- 
nates the second color-drfference component, depend- 
ing on the judgement result of the signal component 

t5 judging means. 

In another preferred construction, the water mark 
data inserting control means comprising a signal com- 
ponent judging means for. upon receipt of the digital 
data signals, judging whether the signal component of 

20 the digital data signal under processing is red-compo- 
nent, green-component, or blue-component, and a 
water mark data selection output means, storing three 
kinds of different water 'mark data prepared for every 
signal component of the above three kinds, for supply- 

25 ing the water mark data prepared correspondingly to the 
red-component to the water mark data inserting device 
when the judgement result designates the red-compo- 
nent, supplying the water mark data prepared corre- 
spondingly to the green-component to the water mark 

30 data inserting device when the judgement result desig- 
nates the green-component, or supplying the water 
mark data prepared correspondingly to the blue-compo- 
nent to the water mark data inserting device when the 
judgement result designates the blue-component, 

35 depending on the judgement result of the signal compo- 
nent judging means. 

In another preferred construction, the digital data 
encode system further comprises a spectrally-resolving 
means for spectrally resolving the digital data signals 

40 upon receipt of them and supplying the obtained 
resolved signals to the water mark data inserting device 
as a subject of inserting the water mark data therein. 

In another preferred construction the digital data 
encode system further comprises a spectrally-resolving 

as means for spectrally resolving the digital data signals 
upon receipt of then, and supplying the obtained 
resolved signals, as a subject of inserting the water 
mark data therein, to the water mark data inserting 
device, and an inversely-converting means, receiving 

50 the processed signals with the water mark data inserted 
therein by the water mark data inserting device, for 
inversely converting the spectrally-resolved data and 
supplying the obtained inversely-converted signals as 
water mark- embedded digital data signals. 

55 In another preferred construction the digital data 
encode system further comprises a discrete cosine 
transform means for performing discrete cosine trans- 
form on the digital data signals upon receipt of them and 
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supplying The obtained transformed signals to the water 
mark data inserting device as a subject of inserting the 
water mark data therein, and an inverse discrete cosine 
transform means, receiving the processed signals with 
the water mark data inserted therein by the water mark 5 
data Inserting device, for performing inverse discrete 
cosine transform on them and supplying the obtained 
inversely-transformed signals as water mark-embedded 
digital data signals. 

In another preferred construction, the digital data 10 
encode system further comprises a spectrally-resolving 
means for spectrally resolving the digital data signals 
upon receipt of them and supplying the obtained 
resolved signals to the water mark data inserting device 
as a subject of inserting the water mark data therein, a 15 
sampling means for sampling the processed signals 
with the water mark data inserted therein by the water 
mark data inserting device to supply sampling signals, 
arfd an image compression means for converting the 
sampling signals into image<ornpressed signals and 20 
supplying the obtained digital data compression data 
signals with the water mark embedded therein. 

In another preferred construction, the digital data 
signals being of a digital data signal consisting of a 
series of image frames. 2s 

further comprises an encoding means for encod- 
ing the digital signals with the water mark data inserted 
therein by use of the water mark data inserting device, 
and an encode controlling means for controlling the 
encoding means so to perform encoding processing in a 30 
plurality of lends of picture types corresponding to the 
encoding methods, 

the water mark data inserting control means 
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comprises water mark data storing means for storing a 
plurality of different water mark data prepared corre- 
spondingly to a plurality of picture types for use in the 
encoding means and the encode controlling means, 
and a water mark data selection output means for, 
depending on the picture type decided by the encode 
controlling means, selecting the corresponding water 
mark data from the water mark data storing means and 
supplying it to the water mark data inserting device, 

the water mark data inserting device comprises a 
partial average calculator for calculating the average of 
the absolute values of three points around each ele- 
ment in the resolved signals supplied from the spec- 
trally-resolving means, as a partial average, a first 
multiplier for multiplying the water mark data supplied 
from the wafer mark data inserting control means by the 
output data of the partial average calculator in every 
element, a second multiplier for multiplying each ele- 
ment of the output data of the first multiplier by a prede- 
termined constant, and an adder for adding the output 
data of the second multiplier and the resolved signals 
supplied from the spectrally-resoMng means in every 
element. 

According to the second aspect of the invention, a 
digital data encode system having a water mark data 
inserting unit including a water mark data inserting con- 
trol means for inserting water mark data into digital data 
signals having a series of field data by control of a water 
mark data inserting device and a water mark data 
detecting unit including a water mark data detecting 
means for detecting the water mark data from the digital 
data signals with the water mark data added thereto by 
the water mark data inserting unit, 
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the water mark detecting unit comprising 
a decoding means for decoding the digital data sig- 
nals encoded by the encoding means of the water 
mark data inserting device, and 
a display controlling means for controlling display s 
depending on the data decoded by the decoding 
means according to the content of the water mark 
data inserted in the digital data signals or according 
to its presence; 

the water mark data detecting means comprising ^ 
a water mark data extracting device for extracting 
candidate data, that is a candidate of the water 
mark data, from the data decoded by the decoding 
means, 

a second water mark data storing means tor storing is 
the same water mark data as the plurality of water 
mark data stored in the first water mark data storing 
means of the water mark data inserting control 
means in the water mark data inserting device, 
a water mark data selection output means for so 
selecting the corresponding water mark data from 
the second water mark data storing means accord- 
ing to the picture type in the encoding processing to 
be recognized in the decoding processing by the 
decoding means and supplying it, and as 
a statistical similarity judging mean for making a 
comparison between the candidate data extracted 
by the water mark data extracting device and the 
water mark data supplied by the water mark data 
selection output means, judging the statistical simi- 30 
larity thereof, and notifying the display controlling 
means of the judgement result. 

In the preferred construction, the water mark data 
inserting unit further comprises a spectrally-resolving 35 
means for dividing the image of the digital data signals 
into blocks of a predetermined size, spectrally resolving 
the corresponding digital data signals in every block, 
and supplying the obtained resolved signals to the 
water mark data inserting device as a subject of Insert- co 
ing the water mark data therein; 

the water mark data inserting device comprises a 
partial average calculator for calculating the aver- 
age of the absolute values of three points around as 
each element in the resolved signals supplied from 
the spectrally-resolving means, as a partial aver- 
age, a first multiplier for multiplying the water mark 
data supplied from the water mark data inserting 
control means by the output data of the partial aver- so 
age calculator in every element, a second multiplier 
for multiplying each element of the output data of 
the first multiplier by a predetermined constant, and 
an adder for adding the output data of the second 
multiplier and the resolved signals supplied from ss 
the spectrally-resolving means in every element, 
the water mark data extracting device of the water 
mark data detecting means comprises a partial 



average calculator for calculating the average of the 
absolute values of three points around the block 
data decoded by the decoding means as a partial 
average, and a divider for dividing the Nock data 
decoded by the decoding means by the output data 
of the partial average calculator. 

According to the third aspect of the invention, a 
water mark data inserting method for inserting water 
mark data in digital data signals having a series of field 
data by use of a water mark data inserting device, com- 
prising 

a step of, after dividing the digital data signals by a 
predetermined reference, inserting a plurality of dif- 
ferent water mark data prepared correspondingly to 
the division into the respective digital data of the 
corresponding divisions, by use of the water mark 
data inserting device. 

In the preferred construction, the digital data sig- 
nals are of a digital data signal having a series of field 
data consisting of odd fields arid even fields of a series 
of image frames. 

further comprising the steps of: 

a step of storing first and second water mark data 
different from each other and prepared for every 
odd field and every even field, 
a step of judging whether the digital data signal is of 
the odd field or the even field one after another, 
a step of selecting one of the first and second water 
mark data as the water mark data to be inserted in 
the digital data signals, according to the judgement 
result in the field judging step, 
a step of spectrally resolving the digital data sig- 
nals, and 

a step of, with respect to the frequency analyzed 
data, as a subject of inserting the water mark data 
therein, obtained as a result of the spectrum resolu- 
tion in the spectrally resolving step, inserting the 
first water mark data into the frequency analyzed 
data of the odd field or inserting the second water 
mark data into the frequency analyzed data of the 
even filed, according to the selection result in the 
water mark data selecting step. 

In the preferred construction, the water mark data 
inserting method further comprises a step of storing 
three kinds of different water mark data prepared for 
every brightness component, first color-difference com- 
ponent, and second color-difference component in the 
signal components of trie digital data signals, a step of 
judging the signal components of the digital data signals 
one after another, a step of selecting one of the above 
three Wnds of water mark data as the water mark data 
to be inserted in the digital signal data, according to the 
judgement result in the signal component judging step, 
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a step of spectrally resolving the digital data signals, 
and a step of, with respect to the frequency analyzed 
data, as a subject of inserting the water mark data 
therein, obtained as a result of The spectrum resolution 
in the spectrally resolving step, inserting the water mark s 
data prepared correspondingly to the brightness com- 
ponent into the data of the brightness component, 
inserting the water mark data prepared correspondingly 
to the first color-difference component into the data of 
the first color-difference component, or inserting the \o 
water mark data prepared correspondingly to the sec- 
ond color-ditference component into the data of the sec- 
ond color-difference component according to the 
selection result in the water mark data selecting step. 

In the preferred construction, the water mark data is 
inserting method further comprises a step of storing 
three kinds of different water mark data prepared for 
every red-component, green-component, and blue- 
component in the signal components of the digital data 
signals, a step of judging the signal components of the 20 
digital data signals one after another, a step of selecting 
one of the above three kinds of water mark data as the 
water mark data to be inserted in the digital signal data, 
according to the judgement result in the signal compo- 
nent judging step, a step of spectrally resolving the dig- ss 
ital data signals, and a step of, with respect to the 
frequency analyzed data, as a subject of inserting the 
water mark data, obtained as a result of the spectrum 
resolution in the spectrally resolving step, inserting the 
water mark data prepared correspondingly to the red- 30 
component into the data of the red-component, insert- 
ing the water mark data prepared correspondingly to the 
green-component into the data of the green-compo- 
nent, or inserting the water mark data prepared corre- 
spondingly to the blue-component into the data of the ss 
blue-component, according to the selection result in the 
water mark data selecting step. 

In another preferred construction, the water mark 
data inserting method further comprises a step of stor- 
ing a plurality of different water mark data prepared for 40 
every plurality of picture types corresponding to the 
encoding methods in encoding the digital data signals, a 
step of judging the signal components of the digital data 
signals one after another, a step of selecting one of the 
above three kinds of water mark data, as the water mark *s 
data to be inserted in the digital signal data, according 
to the judgement result in the signal component judging 
step, a step of spectrally resolving the digital data sig- 
nals, and a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water mark data so 
therein, obtained as a result of the spectrum resolution 
in the spectrally resolving step, inserting the water mark 
data prepared correspondingly to the picture type, 
according to the selection result in the water mark data 
selecting step. ss 

According to another aspect of the invention, a 
computer readable memory for storing a control pro- 
gram tor controlling a digital data encode system having 



a water mark data inserting control means for inserting 
water mark data into digital data signals having a series 
of field data by use of a water mark data inserting 
device, the control program comprising 

a step of, after dividing the digital data signals by a 
predetermined reference, inserting a plurality of dif- 
ferent water mark data prepared correspondingly to 
the division into the respective digital data of the 
corresponding division, by use of the water mark 
data inserting device. 

Other objects, features and advantages of the 
present invention will become clear from the detailed 
description given herebelow. 

BRIEF DESCRIP TION OF THE DRAWINGS 

The present invention will be understood more fully 
from the detailed description given herebelow and from 
the accompanying drawings of the preferred embodi- 
ment of the invention, which, however, should not be 
taken to be limitative to the invention, but are for expla- 
nation and understanding only. 

In the drawings: 

Fig. 1 is a block diagram showing a constitution of a 
digital data encode system according to a first 
embodiment of the present invention. 
Fig, 2 is a flow chart showing an operation of the 
first embodiment. 

Fig. 3 is a block diagram showing a constitution of a 
digital data encode system according to a second 
embodiment of the present invention. 
Fig. 4 is a flow chart showing an operation of the 
second embodiment. 

Fig. 5 is a block diagram showing a constitution of a 
digital data encode system according to a third 
embodiment of the present invention. 
Fig. 6 is a flow chart showing an operation of the 
third embodiment. 

Fig. 7 Is a block diagram showing a constitution of a 

digital data encode system according to a fourth 

embodiment of the present invention. 

Fig. 8 is a block diagram showing a constitution of a 

digital data encode system according to a fifth 

embodiment of the present invention. 

Fig. 9 is a flow chart showing an operation of the 

fifth embodiment. 

Fig. 10 is a block diagram showing a constitution of 
a detecting device for detecting the water mark from 
the data having the water mark Inserted therein 
according to the fifth embodiment. 
Fig. 1 1 is a flow chart showing an operation of the 
detecting device of Fig. 10. 

Fig. 12 is a block diagram showing a constitutional 
example of the conventional digital encode system. 
Fig. 13 is a block diagram showing another const) - 
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tutional example of the conventional digital data 
encode system. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

5 

The preferred embodiment of the present invention 
will be discussed hereinafter in detail with reference to 
the accompanying drawings. In the following descrip- 
tion, numerous specific details are set forth in order to 
provide a thorough understanding of the present inven- 10 
tion. It will be obvious) however, to those skilled in the 
art that the present invention may be practiced without 
these specific details. In other instance, well-known 
structures are not shown in detail in order to unneces- 
sary obscure the present invention. is 

Fig. i is a block diagram showing a constitution of a 
digital data encode system according to a first embodi- 
ment of the present invention. With reference to Fig. 1 , 
the encode system of the embodiment comprises a 
DCT (discrete cosine transform) unit 1 10, a field judging 20 
unit 120, a water mark data selection output unit 130, a 
water mark data inserting device 140, and an inverse 
DCT (inverse discrete cosine transform) unit 150. Fig. 1 
shows only the characteristic components of the 
embodiment, while the description of other general as 
components is not shown there, 

Each component may be realized by an information 
processor and a storage controlled by a computer pro- 
gram (hereinafter, referred to as a control program) in a 
personal computer, a work station or the other computer 30 
system. The information processor includes an internal 
memory for storing data, a signal input port, and a sig- 
nal output port, and executes processing according to 
the control program. Any signal input port will do as far 
as it can receive original image data or its correspond* 35 
ing data, and any signal output port will do as far as it 
can supply the water mark-embedded image data, 
water mark-embedded MPEG stream, or its corre- 
sponding data. The control program can be provided 
stored in a magnetic disk, a semiconductor memory, or <o 
other storing medium, so to be loaded in the information 
processor. A storing medium is not restricted to a partic- 
ular form, but wilt do as far as an information processor 
can read out therefrom. 

In the above components, upon receipt of the digital '5 
data signal (hereinafter, referred to as the original image 
data) 101 having a series of field data consisting of odd 
fields and even fields in a series of image frames, the 
DCT unit 110 performs discrete cosine transform and 
supplies a frequency component signal 102 to the water so 
mark data inserting device 140. The original image data 
having such a data structure includes a digitalized inter- 
lace signal obtained by interlaced scanning, for exam- 
ple, similarly to the television signal in NTSC (National 
Television System Committee) method. In this ease, the 66 
original image data 101 has a data structure where odd 
fields and even fields are disposed by turns. However, in 
the present invention, it is not restricted to this structure 



but it will do as far as the boundary between each field 
is definite. 

The field judging unit 120, upon receipt of the origi- 
nal image data 101, judges whether the field under 
processing is odd field or even field, and supplies the 
field judgement information 103 indicating the judge- 
ment result to the water mark data selection output unit 
130. Field may be judged by use of a synchronous sig- 
nal, for example, in case of the interlaced signal as men- 
tioned above. Alternatively, when the original image 
data 101 has a data structure where another informa- 
tion for indicating odd field or even field is attached to 
each field, field may be judged by use of the information. 
Namely, it is preferable to select and change the field 
judgement method in the field judging unit 120 properly 
according to the data structure of the original image 
data 101. 

The water mark data selection output unit 130 is 
storing a first and second water mark data 1 31 and 1 32. 
The water mark data selection output unit 130, upon 
receipt of the field judgement information 103 supplied 
from the field judging unit 1 20. judges whether the field 
judgement information 103 designates an odd field or 
an even field. Further, the water mark data selection 
output unit 130 selects the first water mark data 131 
when the field judgement information 103 designates an 
odd field, and supplies it as the water mark data 104 to 
the water mark data inserting device 140. While, the 
water mark data selection output unit 130 selects the 
second water mark data 132 when the field judgement 
information 103 designates an even field, and supplies 
it as the water mark data 104 to the water mark data 
inserting device 140. 

The water mark data inserting device 140, upon 
receipt of the frequency component signal 102 from the 
DCT unit 1 10 and the water mark data 104 selected and 
supplied by the water mark data selection output unit 
130, inserts the water mark data 104 in the frequency 
component signal 102 and supplies the frequency com- 
ponent signal 105 with the water mark-embedded 
tfierein to the inverse DCT unit 1 SO. The water mark 
data inserting device 140 may have the same structure 
as the water mark data inserting device 1 240 of the 
above-mentioned conventional technique 4. The fre- 
quency component signal 1 02 is obtained by converting 
the original image data 101 In the frequency compo- 
nents, naturally including the content corresponding to 
the odd and even fields. The water mark data 104 
received from the water mark data selection output unit 
130 is selected correspondingly to the field as men- 
tioned above. According, even in the case where the 
water mark data inserting device 140 has the same 
structure as the conventional technique, if the water 
mark data 104 is inserted in the frequency component 
signal 102 according to the selection result of the water 
mark data selection output unit 130. the first water mark 
data 131 can be embedded in the content correspond- 
ing to the odd field of the original image data 101 and 
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the second water mark data 1 32 can be embedded in water mark data can be inserted by the use of one water 

the content corresponding to the even field. mark data inserting device. Therefore, two water mark 

Upon receipt of the water mark-embedded fre- da t fl can be inserted by use of the same circuit size as 

quency component signal 105 supplied from the waier the conventional technique 4. 

mark data inserting device 1*0, the inverse DCT unit s To make the description clearly, this embodiment 

150 performs inverse discrete cosine transform and has been described with individual functions as the 

supplies the water mark-embedded image data 108. DCT unit 1 10, the field judging unit 120, the water mark 

With reference to the flow chart of Fig. 2, an opera- data selection output unit 1 30, and the water mark data 

lion of the embodiment will be described. As mentioned inserting device 1*0. Otherwise they may be all irrte- 

above, when realizing the encode system of the embod- io grated in water mark data inserting means. At this time, 

i merit in a computer system, a control program for con- the signal supplied from the water mark data inserting 

trolling the information processor includes, at least, means is the same as the water mark-embedded fre- 

instruetions for the information processor performing quency component signal 105 supplied tram the water 

the following respective steps, thereby making the infor* mark data inserting device 140. if the water mark data 

mation processor insert the water mark data in the orig- is inserting means includes the inverse DCT unit 150, the 

inal image data supplied from the signal input port signal supplied from the water mark data inserting 

At first, the first and second water mark data 131 means is the same as the water mark-embedded image 

and 132 are stored into the memory of the water mark data 106. 

data selection output unit 130 (Step 201). At this time, Though the DCT unit 110 is adopted here, by way 

the first and second water mark data T31 and 132 may so of an example of means for supplying the re$oluti'0n eig- 

be provided stored in the same storing medium together nai (frequency component signal 1 02) through the spec- 

with the control program, or they may be provided sep- trum resolution, any means will do as far as it can 

arately from the control program, which is not subject to convert the input signal in the frequency components, 

any restriction. Fig. 3 is a block diagram showing a constitution of a 

When the signal input port receives the original 25 digital data encode system according to a second 

image date 101, the field judging unit 120 makes a embodiment of the present invention. With reference to 

judgement of the field with respect to the received origi- Fig. 2, the encode system of the embodiment com- 

nal data one after another whether it 'is an odd field or prises a DCT unit 1 10, a field judging unit 120, a water 

an even field (Step 202). mark data selection output unit 130, a water mark data 

According to the judgement result by the field judg- so inserting device 140, and a quantizing unit 160, and a 

ing unit 120 in Step 202, the water mark data selection variable-length encoder 170. Fig. 3 shows only the 

output unit 130 selectively assigns the first water mark characteristic components of the embodiment, while the 

data to the odd field and the second water mark data to description of other general components is not shown 

the even field and supplies as such (Step 203). there. 

The DCT unit 110 performs the discrete cosine 3s Instead of the inverse DCT unit 150 in the encode 
transform processing an the received original image system of the first embodiment as shown in Fig. 1, the 
data 101 (Step 204). Any processing will do in this step encode system of the second embodiment comprises 
as far as it is the processing of converting the original the quantizing unit 160. receiving the water mark- 
image data 101 in the frequency components by the embedded frequency component signal 105 supplied 
spectrum resolution. Though this step is positioned 40 from the water mark data inserting device 140, tar sam- 
after Step 203 in Fig, 2, it shall be actually performed pling and quantizing the signal data and the variable- 
simultaneously with Steps 202 and 203. length encoder 170 for, upon receipt of the signal 107 

The water mark data inserting device 140, accord- quantized by the quantizing unit 160, performing the 

ing to the selection result of the water mark data selec- variable-length encoding. The same numerals are 

tion output unit 130 in Step 203, inserts the first water 45 attached to the DCT unit 110, the field judging unit 120, 

mark data in the odd field end inserts the second water the water mark data selection output unit 130. and the 

mark data in the even field (Step 205), in the resultant water mark data inserting device 140, which are consti- 

data 102 obtained through the spectrum resolution by tuted in the same way as the respective components of 

the DCT unit 1 10 in Step 204. the encode system of the first embodiment, so to omit 

The inverse DCT unit 105 thereafter converts the so their description. The quantizing unit 160 and the varia- 

water mark-embedded frequency component signal ble-length encoder 170 may be realized by an inforrna- 

105 supplied from the water mark data inserting device tion processor and a storage of a personal computer, a 

140 into the image data and supplies the same (Step work station, or the other computer system, under the 

206). control of the control program, similarly to the other 

Thus, according to the digital data encode system ss components, 

of this embodiment, the water mark-embedded image Thus constituted encode system of this embod i- 

data with two water mark data embedded therein can be ment inserts two kinds of water mark data into the input 

obtained. Further, according the embodiment two original image data 101 by a series of processing 
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(Steps 401 to 405) similar to the first embodiment as 
described with reference to Fig. 2. quantizes it (Step 
406), and generates the water mark-embedded MPEG 
stream 108 to supply it finally (Step 407) , as illustrated 
in the flow chart of Fig, 4. s 

In this embodiment, though the description has 
been made in the case of performing the MPEG com- 
pression with the quantizing unit 160 and the variable- 
length encoder 170 disposed after the water mark data 
inserting device 140. it is needless to say that it can be io 
applied to another image data compression technique 
in the same concept. Namely, as far as it is provided 
with sampling means for sampling the water mark- 
embedded frequency component signal 10$ to supply 
the sampling signal and image data compression 75 
means for processing the sampling signal into a data 
compressed signal to supply the digital data compres- 
sion signal with the water mark-embedded thereln f it is 
not restricted to this constitution of the embodiment. 

Fig. 5 is a block diagram showing a constitution of a 20 
digital data encode system according to a third embodi- 
ment of the present invention. With reference to Fig. 5, 
the encode system of the embodiment comprises a 
DCT unit 110, a signal component judging unit 180, a 
water mark data inserting device 140. and an inverse 2$ 
DCT unit 150. Fig. 3 shows only the characteristic com- 
ponents of the embodiment, while the description of 
other general components is not shown there. 

In the above constitution, the same numerals are 
attached to the DCT unit 110, the water mark data 30 
inserting device 140, and the inverse DCT unit ISO, 
which are constituted similarly to the respective compo- 
nents of the encode system of the first embodiment as 
shown in Fig. 1 ♦ thereby omitting their description. The 
signal component judging unit 1 80 and the water mark 35 
data selection output unit 190 may be realized by an 
information processor and a storage of a personal com- 
puter, a work station, or the other computer system, 
under the control of the control program, similarly to the 
other components. 40 

The signal component judging unit 180, upon 
receipt of the original image data 101 including Y<om- 
ponent{brightness component), U-component(first 
color-difference component), and V-component(second 
color-difference component), judges whether the signal *s 
components under processing is Y-signal, U-signaJ. or 
V-signal. and supplies the signal component judgement 
information 109 indicating the judgement result to the 
water mark data selection output unit 1 90. 

The water mark data selection output unit 190 is so 
storing three kinds of water mark data 191, 192. and 
193 which are prepared correspondingly to Y-compo- 
nent, U-component and V-component. Upon receipt of 
the signal component judgement information 109 sup- 
plied from the signal component judging unit 180, the ss 
unit 190 selects the corresponding one of the water 
mark data 191, 192, and 193 according to the signal 
component indicated by the signal component judge- 



ment information 109 and supplies the result to the 
water mark data inserting device 140 as the water mark 
data 104. 

An operation of the embodiment will be described 
with reference to the fiow chart of Fig. S. At first, three 
kinds of water mark data 191, 192, and 193 prepared 
correspondingly to Y-component, U-component. and V- 
component are stored in the memory of the water mark 
data selection output unit 190 (Step 601). 

When the signal input port receives the original 
image data 101, the signal component judging unit 180 
judges the signal component of the input original image 
data 101 one after another (Step 60S). 

According to the result judged by the signal compo- 
nent judging unit 180 in Step 602, the water mark data 
selection output unit 190 selectively assigns the water 
mark data corresponding to the signal component of the 
image data 101 and supplies the same (Step 603). 

Since the processing later than the spectrum reso- 
lution of the original image data 101 by the DCT unit 110 
has the same operation as that later than Step 204 
according to the first embodiment as illustrated in Fig. 2. 
their description is omitted (Steps 604 to 606). 

As mentioned above, the digital data encode sys- 
tem of the embodiment can obtain the water mark- 
embedded image data with three kinds of water mark 
data inserted therein correspondingly to Y-component, 
U-component, and v-component of the original image 
data 101. 

Fig. 7 is a block diagram showing a constitution of a 
digital data encode system according to a fourth 
embodiment of the present invention. With reference to 
Fig. 7. the encode system of the embodiment has the 
same structure as the encode system according to the 
third embodiment as shown in Fig. 5. Where, the origi- 
nal image data 101 to be supplied to the DCT unit 110 
and the signal component judging unit 180 is image 
data including R-component(red component), G-com- 
ponent(green component), and B-component(blue 
component). Therefore, the signal component judging 
unit 180 judges whether the signal component of the 
original image daia 101 under processing is R-signal, 
G-signal, or B-signal and supplies the result as the sig- 
nal component judgement information 109. The water 
mark data selection output unit 1 90 stores three kinds of 
water mark data 191, 192, and 193 prepared corre- 
spondingly to R-component, G-component, and B-com- 
ponent, and selects the corresponding one of the water 
mark data 191, 192. and 193 according to the signal 
component indicated by the signal component judge- 
ment information 109, so to supply the same. 

The operation of the embodiment is similar to the 
operation of the third embodiment as shown in Fig. 6 
other than the processing of dividing the signal compo- 
nent of the original image data 101 into R-component, 
G-component, and B -component, thereby omitting the 
description thereof. This embodiment can be applied to 
the case of forming the image data by red component 



11 



25-APR-2002 17:10 



flATHYS & SQUIRE 



020 7830 0001 P. 36/59 



21 



EP0860 997A2 



22 



(R-component), green component (G-componerlt), and 
blue component (B-component) like a personal compu- 
ter. 

A6 means of extracting the water mark data from 
the water mark-embedded image data or water mark- s 
embedded compressed digital data generated by the 
above-mentioned four embodiments, the same method 
as the conventional technique 4 may be used, or other 
method with no need of any original image data may be 
used. For example! the technique for extracting the 10 
water mark data inserted in the frequency components, 
in the existing conventional technique lor extracting the 
water mark data, may be generally applicable. There- 
fore, it may be used for the combination of the copy pro- 
tected information included in the water mark data and is 
the reproducing device having a particular function as 
mentioned in the conventional technique. 

Pig. a is a block diagram showing a constitution of 
an inserting device for inserting water mark data in 
image data, in the digital data encode system according so 
to the fifth embodiment of the present invention. Fig. 10 
is a block diagram showing a constitution of a detecting 
device for detecting the water mark data inserted in the 
image data, in the encode system of the embodiment. In 
this embodiment, the image data subjected to discrete ss 
cosine transform (or spectrum resolution) is overlapped 
with the water mark similarly to the above-mentioned 
four embodiments. The use of the detecting device as 
shown in Fig. 10 enables detection of the water mark 
data from the water mark-embedded image data, with- 30 
out necessity of the original data. 

With reference to Fig, 8, the encode system of the 
embodiment comprises a OCT unit 810, a water mark 
data inserting device 820, a water mark data table for I* 
picture 831 , a water mark data table for P picture 832, a 33 
water mark data table for B-picture 833, a selector 840. 
an encode control unit 850, and an encode unit 860. 
Fig. 8 shows only the characteristic component of the 
embodiment, while the description of other general 
components is omitted there. Each component of the 40 
embodiment may be realized by an information proces- 
sor and a storage of a personal computer, a work sta- 
tion, or the other computer system, under the control of 
the control program, in the same way as the above- 
mentioned other embodiments, 4$ 

The OCT unit 81 0 takes out a block 1 02 of 8 x 6 pix- 
els from the original image 101 that Is the subject of 
inserting the water mark data, and performs discrete 
cosine transform on the image data of the block 102 
(hereinafter, referred to as block image data). As means so 
of converting block image data in the frequency compo- 
nents, the spectrum resolution may be performed 
instead of discrete cosine transform, similarly to the 
above-mentioned embodiments. 

The water mark data inserting device 820 inserts s$ 
proper water mark data of the water mark data stored in 
the water mark data table for l-picture 831 , the water 
mark data table for P-picture 832. and the water mark 



data table for B-picture 833, into the frequency compo- 
nent signal of the block image data supplied from the 
DCT unit 810. The detailed constitution and operation of 
the water mark data inserting device 820 will be 
described below. 

The water mark data table for l-picture 831 stores 
the watermark data for inserting l-picture, the water 
mark data table for P-picture 832 stores the water mark 
data for inserting P-picture. and the water mark data 
table for B-picture 833 stores the water mark data for 
inserting B-picture. 

The selector 840 selects one water mark data of the 
water mark data table for l-picture 831 , the water mark 
data table for P-picture 832, and the water mark data 
table for B-picture 833, to supply it to the water mark 
data inserting device 820 according to the picture type 
803 received from the encode control unit 850. 

The encode control unit 850 decides the picture 
type when encoding the block image data, sends the 
picture type signal 803 to the selector 840, and controls 
the encode unit 860. 

The encode unit 860 encodes the output of the 
water mark data inserting device 840 in accordance 
with MPEG under the control of the encode control unit 
850, and generates and supplies the MPEG data 805. 

As illustrated in Fig. 8, the water mark data insert- 
ing device 830 includes a partial average calculator 823 
for calculating the partial average of the absolute values 
of three points around the frequency component signal 
of the block image data supplied by the DCT unit 81 0 by 
the following formula (1); 



avg(f(i))-(|f(i-1)| + |f(i)| + (f{i + l)|)/3 



0). 



a multiplier 821 for multiplying the water mark data 804 
to be supplied by the selector 840 and the output data of 
the partial average calculator 823. in every element, a 
multiplier 822 for multiplying each output element of the 
multiplier 821 by the constant value a for use in chang- 
ing the size of the water mark and an adder 824 for 
adding the output data of the multiplier 822 and the out- 
put data of the DCT unit 810 in every element. 

Thus-constituted water mark data inserting device 
820 will perform the following calculation: 



F(i)=f(i) + avg(f(i)) * w(i) * constant a 



Where, i is the number of each element of the frequency 
component of a block of 8 * 8 pixels after zigzag scan, 
f(i) is the output data of the DCT unit 810. avg(f(i)) is the 
partial average of the absolute values of three points 
around the data, and w(i) is the value of each element of 
the water mark data 804 supplied by the selector 840. 

This time, an operation of the embodiment will be 
described with reference to the flow chart of Fig. 9. First, 
based on the processing of the ordinal MPEG compres- 
sion, the original image 101 is taken out in every block 
of 8 * 8 pixels, and the DCT unit 810 performs the dis- 
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crete cosine transform processing on the taken out data 
(Step 901). 

The selector 840 selects a table corresponding to 
the picture type, from the water mark data table for I -pic- 
ture 831, the water mark data table for P -picture 832, 5 
and the water mark data table for B-picture 833, accord- 
ing to the picture type 803 supplied from the encode 
control unit 850 and supplies the water mark data 80* to 
the water mark data inserting device 820 (Step 902). 

The water mark data inserting devise 820 Inserts ia 
the water mark data 804 in the block image data con- 
verted in frequency component by the OCT unit 810 
(Step 903). At this time, the water mark data inserting 
device 820 performs the same calculation as the above 
mentioned formula (2). rs 

At last, the encode unit 880 quantizes and encodes . 
the data F(i) supplied from the water mark data inserting 
device 820 (Step 904), and generates and supplies the 
MPEG data 805 with the water mark data inserted 
therein (Step 905). 20 

The description will be made about a detecting 
device for detecting the water mark data from the MPEG 
data 805 with the water mark data inserted therein by 
the digital data encode system of the embodiment With 
reference to Fig. 10, the water mark data detecting 25 
device of the embodiment comprises a decode unit 
1010, an inverse OCT unit 1020, a display control unit 
1030, a water mark data extracting unit 1040, an adder 
1050, an mr\& product calculator 1060, a selector 1070, 
a water mark data table for l-picture 1081 , a water mark 30 
data tabfe for P-picture 1082, a water mark data table 
for B-picture 1083, and a statistical similarity calculator 
1090. Fig. 10 shows only the characteristic components 
of the detecting device of the embodiment, while the 
description of other general components is omitted. 3S 
Each component of the detecting device of the embodi- 
ment may be realized by an information processor and 
a storage of a personal computer, a work station, or the 
other computer system, under the control of the control 
program. <o 

The decode unit 1010 receives the MPEG data 805 
with the water mark data inserted therein, for example, 
supplied from the digital data encode system according 
to the fifth embodiment as shown in Fig. 8. so to decode 
and inversely quantize it. The output data of the decode 4$ 
unit 1010 is transferred to the inverse DCT unit 1020 
and the water mark data extracting unit i04o. The 
decode unit 1010 judges the picture type of the MPEG 
data, generates the picture type signal 1001 and sup- 
plies it to the selector 1 070. so 

The inverse DCT unit 1020, upon receipt of the out- 
put data of the decode unit 1010. performs the inverse 
discrete cosine transform processing on it, to generate 
and supply the image data 1004. The image data 1004 
is supplied to the display control unit 1 030. ss 

The water mark data extracting unit 1040 detects 
the data of 8 * 8 pixel block unit that may become a can- 
didate of the water mark data, from the output data of 



the decode unit 1010 and supplies it The detailed con- 
stitution and operation of the water mark data extracting 
unit 1040 will be described later. 

The adder 1050, upon receipt of the data of 8 * 8 
pixel block unit supplied from the water mark data 
extracting unit 1040, adds the data together for one 
screen in every element and supplies the addition 
result. 

n The selector 1070, upon receipt of the picture type 
signal 1001 from the decode unit 1010, selects one of 
the water mark data table for l-picture 1081, the water 
mark data table for P-picture 1082, and the water mark 
data table for B-picture 1083, according to the picture 
type indicated by the signal, and supplies the water 
mark data being stored therein. 

The water mark data table for l-picture 1081. the 
water mark data table for P-picture 1082, and the water 
mark data table for B-picture 1 083 respectively store the 
same water mark data as being stored in the water mark 
data table for l-picture 831 , the water mark data table for 
P-picture 832, and the water mark data table for ©-pic- 
ture 833 in the encode system of Fig. 8. 

The inner product calculator 1060, upon receipt of 
the output data of the adder 1050 and the water mark 
data 1002 supplied from the selector 1070, calculates 
the inner product of the both data and supplies it. 

Based on the inner product of the output data of the 
adder 1050 and the water mark data 1002, supplied 
from the inner product calculator 1060, the statistical 
similarity calculator 1090 calculates the statistical simi- 
larity of the both data and supplies it. 

The display control unit 1030 receives the image 
data 1004 supplied from the inverse DCT unit 1020 and 
the output data 1003 of the statistical similarity calcula- 
tor 1090, and performs the output control of the display 
data 1005 based on the image data 1004, according to 
the statistical similarity shown in the output data 1003. 
More specifically, if the statistical similarity shown in the 
output data 1003 is a predetermined value or the more, 
the unit 1030 judges that the same water mark data as 
the water mark data 1002 has been inserted in the 
MPEG data 805. When the water mark data 1002 is of 
the copy-protected content, the display control unit 1030 
copy protects the generated image data 1004 and sup- 
plies it as the display data 1005. 

As illustrated in Fig. 10, the water mark data 
extracting unit 1040 includes a partial average calcula- 
tor 1041 for calculating the partial average of the abso- 
lute values of three points around the data of 8 * 8 pixel 
block unit to be supplied from the decode unit 1010 by 
the following formula (3) 

avg(F<i))*<|F<i-1)| + |F<i)| + |F<i + 1)|)/3 (3), 

and a divider 1042 for dividing the data F{l) to be sup- 
plied from the decode unit 1010 by the partial average 
avg (F{i)) to be supplied from the partial average calcu- 
lator 1041. 
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Thus -constituted water mark data extracting unit 
1 040 will perform the following calculation; 



W(i).F(i)/avg(F(i)) 



Where, i is the number of each element of 8 x 8 pixel 
block. F(i) is the output data of the decode unit 1010. 
avg(F(i)) is the partial average of the absolute values of 
three points around the data, and W(i) is the data that 
would become a candidate of the water mark data to be 10 
supplied by the water mark data extracting unit 1040. 

This time, an operation of the embodiment wilt be 
described with reference to the flow chart of Fig. 1 1 . 
First, the decode unit 1010, upon receipt of the MPEG 
data 805 to be inspected, performs the decoding is 
processing in accordance with MPEG on the received 
MPEG data 805 (Step 1101). 

The inverse DCT unit 1020 performs the inverse 
discrete cosine transform processing on the data 
decoded by the decode unit 1010 and generates the ?o 
image data 1004 (Step 1 102). 

The water mark data extracting unit 1040 receives 
the data F(i) of 8 x 8 pixel block supplied from the 
decode unit 1010, performs the calculation of the above 
formula (4). and extracts the data that would become a zs 
candidate of the water mark data inserted in the data 
F(i) (Step 1103). 

The adder 10S0 does a sum of the data values for 
one screen in every element with respect to the 
extracted data of 8 x 8 pixei block unit supplied from the w 
water mark data extracting unit 1040 (Step 1 104). 

The selector 1 070 selects a table corresponding to 
the picture type indicated in the picture type signal 
1001 , from the water mark data table for l-picture 1081 , 
the water mark data table for P-picture 1082. and the 35 
water mark data table for B -picture 1083, according to 
the picture type signal 1001 supplied from the decode 
unit 1010, and supplies the water mark data 1002 to the 
inner product calculator 1080 (Step 1 105). 

The inner product calculator 1060 calculates the 
inner product of the total sum of the extracted data for 
one screen calculated by the adder 1050 and the water 
mark data 1002 supplied from the selector 1070 (Step 
1106). The statistical similarity calculator 1090 calcu- 
lates the statistical similarity according to the inner 45 
product value supplied from the inner product calculator 
1060 (Step 1107). 

At last, the display control unit 1 030 judges whether 
the same water mark data as the water mark data 1002 
has been inserted in the MPEG data 805 or not. so 
depending on the statistical similarity shown in the out- 
put data 1003 of the statistical similarity calculator 1090 
(Step 1108) and performs a proper display control 
depending on the judgement result. 

Thus, the water mark data is detected from the ss 
MPEG data with the water mark data inserted therein 
and a proper operation can be performed in accordance 
with the content thereof, The detecting device of the 



embodiment needs no original image data in detecting 
the water mark data. Therefore, the detecting device 
can be used in the reproducing device of a general user 
having no original image data for the detection of the 
water mark data. 

Though the embodiment adopts MPEG data as the 
data to be transferred from the water mark data insert* 
ing device to the detecting device, it is needless to say 
that it can be applied to the other image data compres- 
sion technique by the similar concept Further, it may be 
constituted in that the water mark data is inserted 
before performing the inverse discrete cosine transform 
processing, thereby transferring the data as the water 
mark-embedded image data. 

As set forth hereinabove, the digital data encode 
system of the present invention is capable of inserting a 
plurality of water mark data in one image data, thereby 
inserting a plurality of information therein by the water 
mark data. 

Since the present invention divides the image data 
according to the field, signal component, and frame, 
and inserts each water mark data corresponding to the 
division by use of one water mark data inserting device, 
it can realize the insertion of a plurality of water mark 
data into one original image data at the same circuit size 
as the conventional digrtal data encode system. 

Since the present invention divides the image data 
according to the field, signal component, and frame, 
and inserts each different water mark data for every 
dividing unit, it can reduce the deterioration of the image 
quality compared with the case of inserting a plurality of 
water mark data in every division. 

Although the invention has been illustrated and 
described with respect to exemplary embodiment 
thereof, it should be understood by those skilled in the 
art that the foregoing and various other changes, omis- 
sions and additions may be made therein and thereto, 
without departing from the spirit and scope of the 
present invention. Therefore, the present invention 
should not be understood as limited to the specific 
embodiment set out above but to include all possible 
embodiments which can be embodies within a scope 
encompassed and equivalents thereof with respect to 
the feature set out in the appended claims. 

Claims 

1. A digital data encode system having a water mark 
data inserting device for inserting water mark data 
into digital data signals having a series of field data, 
comprising; 

a water mark data inserting control means for 
controlling inserting of said water mark by said 
water mark data inserting device; 

wherein said water mark data inserting 
control means divides the digrtal data signals 
by a predetermined reference and inserts a 
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plurality of different water mark data prepared 5. 
correspondingly to the division into the respec- 
tive digital data of the corresponding divisions 
by use of said water mark data inserting 
device. 5 

2. A digital data encode system as set forth in Claim 1 , 
wherein 

said digital data signals are of a digital data sig- '<? 
na) having a series of field data consisting of 
odd fields and even fields of a series of image 
frames, and 

said water mark data inserting control means 
inserts first and second water-mark data differ- is 
ent from each other and prepared for ovary odd 
filed and every even field into the respective 
corresponding fields, by use of said water mark 
data inserting device. 

20 

3. A digital data encode system as set forth in Claim 1 , 
wherein 

said digital data signals are of a digital data sig- 
nal having a series of field data consisting of ss 
odd fields and even fields in a series of image 
frames, and 

said water data inserting control means com- 
prising 

a field judging means (120) for judging whether ao 
the filed data under processing is of an odd 
field or an even field upon receipt of the digital 
data signals, and 

a water mark data selection output means 6. 
(1 30), storing first and second water mark data s$ 
(131, 132) different from each other and pre- 
pared for every odd field and every e/en fiefd, 
for supplying the first water mark data (131) to 
said water mark data inserting device (140) 
when the judgement result designates the odd «o 
field, or supplying the second water mark data 
(132) to said water mark data inserting device 
(140) when the judgement result designates 
the even filed, depending on the judgement 
result by said field judging means (120). 45 

4. A digital data encode system as set forth in Claim 1 , 
wherein 

said water mark data inserting control means so 
inserts a plurality of different water mark data 
(191, 192, 193) prepared for every signal com- 
ponent of the digital data signals extracted by a 
predetermined reference into the respective 
digrtal data signals of the corresponding signal ss 
components, by use of said water mark data 
inserting device. 



A2 28 

A digital data encode system as set forth in Claim 1 , 
wherein 

said water mark data inserting control means 
comprising 

a signal component judging means (180) tor. 
upon receipt of the digital data signals, judging 
whether the signal component of the digital 
data signal under processing is brightness 
component, first color-difference component, 
or second color-difference component, and 
a water mark data selection output means 
(190), storing three kinds of different water 
mark data (191, 192, 193} prepared for every 
signal component of the above three kinds, for 
supplying the water mark data (191) prepared 
correspondingly to the brightness component 
to said water mark data inserting device (140) 
when the judging result designates the bright- 
ness component, supplying the water mark 
data (192) prepared correspondingly to the first 
color-difference component to said water mark 
data inserting device (140) when the judge- 
ment result designates the first color-difference 
component, or supplying the water mark data 
(193) prepared correspondingly to the second 
color<jifference component to said water mark 
data inserting device (140) when the judge- 
ment result designates the second color-differ- 
ence component, depending on the judgement 
result of said signal component judging means 
(180). 

A digital data encode system as set forth in Claim 1 , 
wherein 

said water mark data inserting control means 
comprising 

a signal component judging means (180) for, 
upon receipt of the digital data signals, judging 
whether the signal component of the digital 
data signal under processing is red-compo- 
nent, green-component, or blue-component, 
and 

a water mark data selection output means 
(190). storing three kinds of different water 
mark data (191, 192, 193) prepared for every 
signal component of the above three kinds, for 
supplying the water mark data (191) prepared 
correspondingly to the red -component to said 
water mark data inserting device (140) when 
the judgement result designates the red-com- 
ponent, supplying the water mark data (192) 
prepared correspondingly to the green-compo- 
nent to said water mark data inserting device 
(140) when the judgement result designates 
the green-component, or supplying the water 
mark data (193) prepared correspondingly to 
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the blue-component to said water mark data 
inserting device (140) when the judgement 
result designates the blue-component, 
depending on the judgement result of said sig- 
nal component judging means (1 80). s 

7. A digital data encode system as set forth in Claim 1 , 
further comprising 

a spectrally-resolving means (110) for spec- w 
trally resolving the digital data signals upon 
receipt of them and supplying the obtained 
resolved signals to said water mark data insert- 
ing device (1*0) as a subject of Inserting the 
water mark data therein. 75 

8. A digital data encode system as set forth in Claim 1 , 
further comprising 

a spectrally-resolving means (110) for spec- 20 
trally resolving the digital data signals upon 
receipt of then, and supplying the obtained 
resolved signals, as a subject of inserting the 
water mark data therein, to said water mark 
data inserting device (1 40), and ss 
an inversely-converting means (1S0) P receiving 
the processed signals with the water mark data 
inserted therein by said water mark data insert- 
ing device (140), for inversely converting the 
spectrally-resolved data and supplying the 30 
obtained inversely-converted signals as water 
mark-embedded digital data signals. 



A digital data encode system as set forth in Claim 1, 
further comprising 
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a discrete cosine transform means (110) for 
performing discrete cosine transform on the 
digital data signals upon receipt of them and 
supplying the obtained transformed signals to 40 
said water mark data inserting device (140) as 
a subject of inserting the water mark data 
therein, and 

an inverse discrete cosine transform means 
(150), receiving the processed signals with the 45 
water mark data inserted therein by said water 
mark data inserting device (140), for perform- 
ing inverse discrete cosine transform on them 
and supplying the obtained inversely-trans- 
formed signals as water mark-embedded dig- so 
ital data signals. 

10. A digital date encode system as set forth in Claim 1 , 
further comprising 



55 



a spectrally-resolving means (110) for spec- 
trally resolving the digital data signals upon 
receipt of them and supplying the obtained 



resolved signals to said water mark data insert- 
ing device (140) as a subject of inserting the 
water mark data therein, 
a sampling means (160) for sampling the proc- 
essed signals with the water mark date 
inserted therein by said water mark data insert- 
ing device (140) to supply sampling signals, 
and 

an image compression means (170) for con- 
verting the sampling signals into image-com- 
pressed signals and supplying the obtained 
digital data compression data signals with the 
water mark embedded therein. 

1 1 . A digital data encode system as set forth in Claim 1 , 

said digital data signals being of a digital data 
signal consisting of a series of image frames; 

further comprising 
an encoding means (860) for encoding the dig- 
ital signals with the water mark data inserted 
therein by use of said water mark data inserting 
device, and 

an encode controlling means (650) for control- 
ling said encoding means (860) so to perform 
encoding processing in a plurality of kinds of 
picture types corresponding to the encoding 
methods, 

said water mark data inserting control means 
comprising 

water mark data storing means (831, 832, 833) 
for storing a plurality of different water mark 
data prepared correspondingly to a plurality of 
picture types for use in said encoding means 
(860) and said encode controlling means (850), 
and 

a water mark data selection output means 
(840) for. depending on the picture type 
decided by said encode controlling means 
(850), selecting the corresponding water mark 
data from said water mark data storing means 
(831, 832. 833) and supplying it to said water 
mark data inserting device (820). 

12. A digital data encode system as set forth in Claim 1, 

said digital data signals being of a digital data 
signal consisting of a series of image frames; 

further comprising 
a spectrally-resolving means (810) for dividing 
the image of the digital data signals into blocks 
of a predetermined size, spectrally resolving 
the corresponding digital data signals in every 
block, and supplying the obtained resolved sig- 
nals to said water mark data inserting device 
(820) as a subject of inserting the water mark 
data therein, 

an encoding means (860) for encoding the dig- 



16 



25-RPR-2002 17:13 



MftTHYS a SQUIRE 



020 7830 0001 P. 41/59 



31 EP 0 860 997 A2 

ital signals with the water mark data inserted 
therein by use of said water mark data inserting 
device (820). and 

an encode controlling means (850) for control- 
ling said encoding means (860) so to perform s 
encoding processing in a plurality of kinds of 
picture types, 

said water mark data inserting control means 
comprising 

water mark data storing means (83 1 . 832, 933) " 
for storing a plurality of different water mark 
data prepared correspondingly to a plurality of 
picture types for use in said encoding means 
(860) and said encode controlling means (850), 
and T5 
a water mark data selection output means 
(840) for. depending on the picture type 
decided by said encode controlling means 
(850). selecting the corresponding water mark 
data from said water mark data storing means so 
(831, 832, 833) and supplying it to said water 
mark data inserting device (820). 
said water mark data inserting device (820) 
comprising 

a partial average calculator (823) for calculat- ss 
ing the average of the absolute values of three 
points around each element in the resolved sig- 
nals supplied from said spectrally-resolving 
means (810), as a partial average, 
a first multiplier (821) for multiplying the water so 
mark data supplied from laid water mark data 
inserting control means by the output data of 
said partial average calculator (823) in every 
element, 

a second multiplier (822) for multiplying each 3s 
element of the output data of said first multiplier 
(821) by a predetermined constant, and 
an adder (824) for adding the output data of 
said second multiplier (822) and the resolved 
signals supplied from said spectrally-resolving 40 
means (810) in every element. 

13. A digital data encode system having a water mark 
data inserting unit including a water mark data 
inserting control means for inserting water mark 4S 
data into digital data signals having a series of field 
data by control of a water mark data inserting 
device (820) and a water mark data detecting unit 
including a water mark data detecting means for 
detecting the waier mark data from the digital data so 
signals with the water mark data added thereto by 
said water mark data inserting unit; 

said digital data signals being of a digital data 
signal consisting of a series of image frames; ss 
said water mark data inserting unit further com- 
prising 

an encoding means (860) for encoding the dig- 



32 

ital data signals with the water mark data 
inserted therein by use of said water mark data 
inserting device (320), and 
an encode controlling means (850) for control- 
ling said encoding means (860) so to perform 
encoding processing in a plurality of kinds of 
picture types corresponding to the encoding 
methods; 

said water mark data inserting control means 
comprising 

first water mark data storing means (831 , 832, 
833) for storing a plurality of different water 
mark data prepared correspondingly to a plu- 
rality of picture types for use in said encoding 
means (860) and said encode controlling 
means (850), and 

a water mark data selection output means 
(840) for, depending on the picture type 
decided by said encode controlling means 
(850). selecting the corresponding water mark 
data from said first water mark data storing 
means (631 . 832, 833) and supplying it to said 
water mark data inserting device (820); 
said water mark detecting unit comprising 
a decoding means (1010) for decoding the dig- 
ital data signals encoded by said encoding 
means (860) of said water mark data inserting 
device, and 

a display controlling means (1030) for control- 
ling display depending on the data decoded by 
said decoding means (1010) according to the 
content of the water mark data inserted in the 
digital data signals or according to its pres- 
ence; 

said water mark data detecting means com- 
prising 

a water mark data extracting device (1040) for 
extracting candidate data, that is a candidate of 
the water mark data, from the data decoded by 
said decoding means, 

a second water mark data storing means 
(1081. 1082. 1083) for storing the same water 
mark data as the plurality of water mark data 
stored in said first water mark data storing 
means of said water mark-data inserting con- 
trol means in said water mark data inserting 
device, 

a water mark data selection output means 
(1070) for selecting the corresponding water 
mark data from said second water mark data 
storing means (1081 , 1082. 1083) according to 
the picture type in the encoding processing to 
be recognized in the decoding processing by 
said decoding means (101Q) and supplying it, 
and 

a statistical similarity judging mean (1090) for 
making a comparison between the candidate 
data extracted by said water mark data extract- 
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ing device (1040) and the water mark data sup- 
plied by said water mark data selection output 
means (1070), judging the statistical similarity 
thereof, and notifying said display controlling 
means (1 030) of the judgement result. $ 

14* A digital data encode system as claimed in Claim 
13, 

said water mark data inserting unit further com- to 
prising 

a spectrally-resolving means (810) for dividing 
the image of the digital data signals into blocks 
of a predetermined size, spectrally resolving 
the corresponding digital data signals in every 75 
block and supplying the obtained resolved sig- 
nals to said water mark data inserting device 

(820) as a subject of inserting the water mark 
data therein; 

said water mark data inserting device (820) so 
comprising 

a partial average calculator (823) for calculat- 
ing the average of the absolute values of three 
points around each element in the resolved sig- 
nals supplied from said spectrally-resolving 25 
means (810). as a partial average, 
a first multiplier (821) for multiplying the water 
mark data supplied from said water mark data 
inserting control means by the output data of 
said partial average calculator (823) in every 30 
element, 

a second multiplier (822) for multiplying each 
element of the output data of said first multiplier 

(821) by a predetermined constant, and 

an adder (824) for adding the output data Of ss 

said second multiplier (822) and the resolved 

signals supplied from said spectrally-resolving 

means (810) in every element; 

said water mark data extracting device (1040) 

of said water mark data detecting means com- *o 

prising 

a partial average calculator (1041) for calculat- 
ing the average of the absolute values of three 
points around the block data decoded by said 
decoding means (1010) as a partial average, 45 
and 

a divider (1042) for dividing the block data 
decoded by said decoding means (101Q) by 
the output data of said partial average calcula- 
tor (1041). 50 

15. A water mark data inserting method for inserting 
water mark data in digital data signals having a 
series of field data by use of a water mark data 
inserting device, comprising ss 

a step of, after dividing the digital data signals 
by a predetermined reference, inserting a plu- 



rality of different water mark data prepared cor- 
respondingly to the division into the respective 
digital data of the corresponding divisions, by 
use of said water mark data inserting device. 

16. A water mark data inserting method as set forth in 
Claim 15, wherein 

said digital data signals are of a digital data sig- 
nal having a series of field data consisting of 
odd fields and even fields of a series of image 
frames, 

further comprising the steps of: 
a step of storing first and second water mark 
data different from each other and prepared for 
every add field and every even field, 
a step of judging whether the digital data signal 
is of the odd field or the even field one after 
another, 

a step of selecting one of the first and second 
water mark data as the water mark data to be 
inserted in the digital data signals, according to 
the judgement result in said field judging step, 
a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the first water mark data into the 
frequency analyzed data of the odd field or 
inserting the second water mark data into the 
frequency analyzed data of the even filed, 
according to the selection result in said water 
mark data selecting step. 

17. A water mark data inserting method as set forth in 
Claim 15. further comprising 

a step of storing three kinds of different water 
mark data prepared for every brightness com- 
ponent, first color-difference component, and 
second color-difference component in the sig- 
nal components of the digital data signals, 
a step of judging the signal components of the 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data as the water mark data to 
be inserted in the digital signal data, according 
to the judgement result in said signal compo- 
nent judging step. 

a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the water mark data prepared 
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correspondingly to tho brightness component 
into the data of the brightness component, 
inserting the water mark data prepared corre- 
spondingly to the first color-difference compo- 
nent into the data of the first color-difference s 
component, or inserting tfie water mark data 
prepared correspondingly to the second coior- 
difference component into the data of the sec- 
ond color-difference component, according to 
the selection result in said water mark data to 
selecting step. 

18. A water mark data inserting method as set forth 
Claim 1 5, further comprising 

is 

a step of storing three kinds of different water 
mark data prepared for every red-component, 
green-component, and blue-component in the 
signal components of the digital data signals, 
a step of judging the signal components of the 2c 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data as the water mark data to 
be inserted in the digital signal data, according 
to the judgement result in said signal compo- zs 
nent judging step, 

a step of spectrally resolving the digital data 
signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water so 
mark data, obtained as a result of the spectrum 
resolution in said spectrally resolving step, 
inserting the water mark data prepared corre- 
spondingly to the red-component into the data 
of the red-component, inserting the water mark 3s 
data prepared correspondingly to the green- 
component into the data of the green-compo- 
nent, or inserting the water mark data prepared 
correspondingly to the blue-component into the 
data of the blue-component, according to the *o 
selection result in said water mark data select- 
ing step. 

19. A water mark data inserting method as set forth in 
Claim 1 5, further comprising 4S 

a step of storing a plurality of different water 
mark data prepared for every plurality of picture 
types corresponding to the encoding methods 
in encoding the digital data signals, so 
a step of judging the signal components of the 
digital data signals one after another, 
a step of selecting one of the above three kinds 
of water mark data, as the water mark data to 
be inserted in the digital signal data, according ss 
to the judgement result in said signal compo- 
nent judging step, 

a step of spectrally resolving the digital data 



36 

signals, and 

a step of, with respect to the frequency ana- 
lyzed data, as a subject of inserting the water 
mark data therein, obtained as a result of the 
spectrum resolution in said spectrally resolving 
step, inserting the water mark data prepared 
Correspondingly to the picture type, according 
to the selection result in said water mark data 
selecting step. 
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